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(54) Motion detection from an encoded image bit stream 



(57) Motion detecting apparatus has a separation 
unit (1 30), an operation unit (140) and a comparison unit 
(150). The separation unit (130) separates a bit stream 
in relation to a motion predicted image from a com- 
pressed encoded image bit stream. The operation unit 
(140) calculates an average value of the bit stream in 
relation to the motion predicted image separated at the 
separation unit (130). The comparison unit (150) detects 



a motion when the average value is greater than a pre- 
determined threshold after comparing the average val- 
ue and thethreshold. Thus, because a motion in an input 
image can be detected by using a compressed encoded 
image bit stream, a separate circuit or input image 
processing is not required to detect the motion and ad- 
verse affects of camera noise on the detection results 
can be reduced. 
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Description 

[0001 ] The present invention relates to a video motion 
detection method and a video motion detection appara- 
tus. 5 
[0002] The amount of image data produced by digital 
monitoring systems can be enormous. Therefore, imag- 
es from digital monitoring systems are generally com- 
pressed before being transmitted or stored. Motion de- 
tection, i.e. Detection of movement within the scene 
captured by a camera, is used to trigger the sending of 
an image to a remote operator for viewing on a PDA or 
an IMT terminal or uploading of the image to an FTP 
server 

[0003] When the above methods are applied, the 
monitoring system can be effectively operated without 
unnecessarily loading the system because of the large 
amount of data. Furthermore, when only images cap- 
tured when there is movement in the scene are stored 
into a hard disk, as in the case of a DVR (Digital Video 
Recorder) for example, the efficiency of the hard disk 
usage can be improved. Thus, when a DVR product or 
a network monitoring system has a motion detection 
function, the efficiency of the product is improved. 
[0004] A conventional method of motion detection is 
based on the difference between successive image. 
More particularly, a statistical value, such as an average 
or a standard deviation, is derived from the pixel values 
is a difference image, i.e. the result of subtracting the 
pixels of one image from another, is compared with an 
empirically determined threshold so that the motion can 
be detected from the image. 
[0005] Figure 1 is a block diagram of a conventional 
apparatus for detecting motion in an input image using 
the difference image technique, and Figure 2 is a flow- 
chart showing a method of detecting motion used by the 
detecting apparatus shown in Figure 1. 
[0006] Referring to Figure 1 , a conventional motion 
detecting apparatus comprises an A/D conversion unit 
10, a filtering unit 20, a memory 30, an operation unit 
40, a comparison unit 50 and a warning unit 60. 
[0007] Referring to Figure 2, the A/D conversion unit 
10 initially converts an analogue image signal, from a 
camera, into a digital signal. Noise is removed from the 
converted digital image data at the noise removing fil- 
tering unit 20, and then the noise-free converted digital 
image data is input into the memory 30 and the opera- 
tion unit 40. At operations 10 and 20, the memory 30 
stores a previously input image (P) and a currently input 
image (C) for comparison and, at operation 30, the op- 
eration unit 40 obtains a difference image (D) from the 
noise free currently input image (C) and the previously 
input image (P), stored in the memory 30. At operation 
40, the comparison unit 50 compares the difference im- 
age (D) value for each pixel with a threshold (t1) to de- 
termine which pixels are in a moving part of the scene 
and, at operations 41 , 42, a motion binarization process 
generates a binarized motion image by setting each pix- 



el to one one of two values, corresponding to motion 
and static, in operation 40), Then, at operation 50, the 
operation unit 40 calculates the sum (EBD) of the pixels 
of the binarized image (BD). At operation 60, the sum 
(EBD) of the pixels of the binarized image (BD) is com- 
pared with a predetermined threshold (t2). At operation 
60, if the sum (IBD) of the binarized image (BD) is great- 
er than the threshold (t2), it is determined that there has 
been motion scene and, at operation 70, a motion de- 
tection warning is generated by the warning unit 60. 
[0008] The motion detecting method using the differ- 
ence image can obtain a great amount of information 
from each pixel unit and has the advantage of detecting 
motion by using various statistical features of the differ- 
ence image. However, the operation of the conventional 
motion detection method is slow because data is ob- 
tained and processed for each pixel and there is a dis- 
advantage in that the detected result can be sensitive 
to or negatively impacted by camera noise or a change 
in the external environment. 

Moreover, the method of detecting the motion in an input 
image by using the difference image requires extra 
frame memory to store the previous and current input 
image data to compare the previously input image and 
the currently input image. Such a method also requires 
a noise-removing filter to prevent mis-operation caused 
by the camera noise. Furthermore, it is difficult to set up 
the thresholds (t1 ) and (t2) so that motion can be reliably 
detected. 

[0009] A video motion detection method according to 
the present invention is characterised byobtaining inter- 
frame coded frames of a video bit stream comprising 
inter-frame and intra-frame coded frames, maintaining 
an average of the inter-frame coded frame bit lengths 
and determining the presence of motion in the scene 
represented by said video bitstream using said average. 
[0010] A video motion detection apparatus according 
to the present invention is characterised by means for 
obtaining inter-frame coded frames of a video bit stream 
comprising inter-frame and intra-frame coded frames, 
means for maintaining an average of the inter-frame 
coded frame bit lengths and means for determining the 
presence of motion in the scene represented by said vid- 
eo bitstream using said average. 
[0011] The presence of motion may be detected by 
comparing said average with a threshold. However, the 
presence of motion is preferably detected by comparing 
the rate of change of said average with a threshold. 
[0012] The means for extracting inter-frame coded 
frames, the means for maintaining an average of the in- 
ter-frame coded frame bit length and the means for de- 
termining the presence of motion in the scene repre- 
sented by said video bitstream using said average may 
be implemented by a programmed computer. 
[0013] According to the present invention, there is al- 
so provided a signal, e.g. a series data packets, repre- 
senting computer program codes for programming a 
computer to form an apparatus according to the present 
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invention. 

[0014] The signal may be an electric or electromag- 
netic signal. 

[0015] According to the present invention, there is al- 
so provided a data carrier, e.g. a CDROM, from which 
a signal according to the present invention can be re- 
produced. 

[001 6] Embodiments of the present invention will now 
be described, by way of example, with referene to Fig- 
ures 3 to 8B ofthe accompanying drawings, in which: 

Figure 1 is a block diagram of a conventional motion 
detection apparatus detecting motion in image da- 
ta; 

Figure 2 is a flowchart of the motion detection meth- 
od used by the apparatus of Figure 1 ; 
Figure 3 is a block diagram of an image processing 
system according to the present invention; 
Figures 4, 5A and 5B are flowcharts illustrating the 
operation of the system shown in Figure 3; 
Figures 6A and 6B are graphs of bit lengths in an 
intra mode and in an inter mode; 
Figures 7A and 8A are graphs showing average val- 
ues of bit streams; and 

Figures 7B and 8B are graphs showing average val- 
ues of an inter mode image bit stream of an inter 
mode. 

[0017] Referring to Figure 3, an image processing 
system comprises an image input unit 100, an A/D con- 
version unit 110, an image compression unit 120, a sep- 
aration unit 130, an operation unit 140, a comparison 
unit 1 50, an output unit 1 60 and a transmission unit 1 70. 
[0018] The image input unit 100 is a device, such as 
a video camera, for converting an image into an electri- 
cal signal. The image signal may be analogue or digital 
depending on the nature ofthe image input unit 100. If 
the image signal is analogue, the A/D conversion unit 
1 1 0 converts it into a digital signal. 
[0019] The image compression unit 120 encodes and 
compresses the digital image signal received from the 
A/D conversion unit 110 (or the image input unit 100 if 
it is a digital device). There are two kinds of frames in 
the bit stream output by the image compression unit 
120. In the first kind, the bit stream is formed by encod- 
ing the received digital image signal with motion predic- 
ton. In the second kind, the bit stream is formed by en- 
coding the the received digital image signal without mo- 
tion prediction. The motion prediction can use an inter 
mode (i.e. based upon an inter-framecompression tech- 
nique) that transmits the difference between first and 
second frames in terms of motion vectors for macro 
blocks. When motion prediction is not used, an intra 
mode compression technique, such Discrete Cosine 
Transform (DCT), is applied to the current frame without 
reference the neighbouring frames. 
[0020] The separation unit 130 separates out the 
frames for which the inter mode encoding and compres- 



sion has been used by the image compression unit 1 20. 
In other words, the the inter mode coded frames, but not 
the intra mode coded frames, in the bit stream are 
passed to the operation unit 140. 

5 [0021] The operation unit 140 calculates an average 
value of the inter mode frames from the separation unit 
1 30. The comparison unit 1 50 compares a signal corre- 
sponding to the average value input from the operation 
unit 140 with a signal corresponding to a threshold set 

10 up in advance, and if the signal corresponding to the 
average value is greater than the threshold, the com- 
parison unit 150 determines that there is motion in the 
scene and sends a detection signal to the output unit 
160. 

15 [0022] The output unit 160 determines that there is 
movement (motion) when the detection signal is trans- 
mitted from the comparison unit 150 to the output unit 
160, and outputs a warning signal in response to the 
detected motion. For example, a warning sound can be 

zo generated or a warning message can be transmitted to 
a remote terminal, such as a wireless terminal. Further- 
more, the transmission unit 1 70 transmits the frame in 
which motion was detected through a network in re- 
sponse to a warning signal (e.g., when a warning signal 

25 is transmitted from the output unit 1 60 to the transmis- 
sion unit 1 70, etc.). Typically, the output unit 1 60 and the 
transmission unit 1 70 can be part of an existing network 
image monitoring system and interfaced with process- 
ing units 110 through 150. 

30 [0023] The amount of data for an inter mode coded 
frame becomes great when there is motion in the scene 
being monitored. Therefore, the average value of the in- 
ter mode coded frames can be a substantially reliable 
predictor of motion. More particularly, an increase in the 

35 average value of the inter mode coded frames indicates 
motion and, thus, when detected enables a motion de- 
tection signal to be reliably output. 
[0024] The processes of the present invention as em- 
bodied in units 100 through 150 can be implemented 

^0 using software and/or hardware as part of a main 
processing unit of a network digital image monitoring 
system receiving video camera signals (e.g., a compu- 
ter server). The main processing unit would output and/ 
or transmit information (e.g. warning signals, images, 

4 5 etc.) to other devices of the network digital image mon- 
itoring system, in response to detected motion in images 
received from a camera monitoring an area. 
[0025] Referring to Figures 4 and 5A, at operations 
400 and 410, when an analogue image signal is output 

50 from the image input unit 100, the A/D conversion unit 
1 1 0 converts the analogue signal into a digital signal. At 
operation 420, the digital signal is input into the image 
compression unit 120 and encoded according to an en- 
coding method to output compressed bit streams. Typ- 

55 jcally, the image compression unit 120 uses a combina- 
tion of inter-frame and intra-frame compression/encod- 
ing methods, as in MPEG (Moving Picture Experts 
Group) encoding, which encodes the received digital im- 
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age signal. 

[0026] Using the MPEG encoding standard as an ex- 
ample, when the inter mode coded frames and the intra 
mode coded frames are output from the image compres- 
sion unit 120 and input into the separation unit 130, at 
operation 430, the separation unit 1 30 separates the in- 
ter mode coded frames (i.e. B- and P- frames) from the 
intra mode coded frames by passing only the inter mode 
coded frames to the operation unit 440. The operation 
unit 1 40 obtains an average size value (Ma) for the data 
representing the inter-mode coded frames. The average 
value of the inter mode coded frames is very small when 
there is little movement but increases when there is 
movement. 

[0027] When the average value for the inter mode 
coded frames has been obtained by the operation unit 
1 40 and input into the comparison unit 1 50, the compar- 
ison unit 1 50 compares the average value with a set up 
threshold T^ at operation 450. At operation 460, if the 
obtained average value is greater than the threshold Tj , 
a corresponding motion signal, indicating motion detec- 
tion, is output. More particularly, at operation 450, if it is 
determined that the average value for the inter mode 
coded frames is greater than the threshold T 1t at oper- 
ation 460, the output unit 1 60 determines there is motion 
in the received image sequence in response to the mo- 
tion detection signal from the comparison unit 150 and 
outputs a warning signal in response to the motion de- 
tection. Furthermore, the transmission unit 170 can 
transmit the image data with the detected motion 
through the network based on the warning signal. More 
particularly, at operation 460, the output unit 160 imple- 
mented as a control process (software) can control 
warning of motion detection, storing of corresponding 
image data, or transmission of a motion detection mes- 
sage by electronic messaging, e.g. Email or SMS, to a 
PDA or a mobile phone. 

[0028] Referring to Figure 5B, in another embodi- 
ment, at operation 440, the operation unit 140 obtains 
the average value (Ma) of the inter mode image bit 
stream, and after that, at operation 441 , calculates the 
change (DMa) of the average value (Ma) between suc- 
cessive frames. At operation 442, the comparison unit 
150 determines whether there is movement in the re- 
ceived image signal by comparing the obtained change 
(DMa) with a threshold T 2 . More particularly, at opera- 
tion 442, if the obtained change is greater than the 
threshold T 2 , the comparison unit 150 determines that 
there is motion in the received image signal and outputs 
a motion detection signal to the output unit 160. At op- 
eration 441 , the change in the average between the inter 
mode coded frames is almost zero when there is little 
movement. Yet, when there is movement in the received 
image signal, the change in the average (DMa) between 
inter mode coded frames is very large compared to the 
case that there is not movement, The threshold T 2 is set 
according empirically. 

[0029] At operation 445, the output unit 160 deter- 
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mines that there is motion in the received image signal 
in dependence on the motion detection signal from the 
comparison unit 1 50 and outputs a warning signal in re- 
sponse to the motion detection. More particularly, the 
s processes of operation 445 by the output unit 160 are 
similar to the processes of the output unit 160 at oper- 
ation 460 in Figure 5A. 

[0030] Motion detection in a video signal by an auto- 
matic network image monitoring system according to 

10 the present invention will now be described. 

[0031] The image input unit 100 can be one or more 
video cameras installed in to monitor an monitored area 
and in communication, via a network, with a main 
processing unit (not shown), such as a computer. Typi- 

'5 cally, the processes of the present invention are imple- 
mented in the processing unit. Typically, the image input 
unit 1 00 transmits image data as an analogue signal to 
the processing unit when a camera is an analogue cam- 
era and the image input unit 100 transmits the image 

20 data as a digital signal when the camera is a digital cam- 
era. When the image data is input as an analog signal, 
the image data is converted into a digital signal by the 
A/D conversion unit 110, When the image input unit 1 00 
comprises digital video cameras, the A/D conversion 

25 unit 110 does not have to be installed (i.e. the A/D con- 
version unit 110 may be omitted). 
[0032] When the image signal is input, the automatic 
monitoring system network can, for example, transmit 
the image signal to other components and devices, such 

30 as a display monitor, and can compress the input image 
signal for storage in a DVR. When the input image signal 
is compressed, the image compression unit 120 en- 
codes the image signal, using a combination of inter- 
frame and intra-frame compression techniques. The im- 

35 age compression unit 120 outputs an encoded bit 
stream. 

[0033] The bit stream output from the image compres- 
sion unit 120 is transmitted to the separation unit 130, 
The separation unit 1 30 is set up to pass the inter mode 

40 coded frames only. Thus, the inter mode coded frames 
and the intra mode coded frames are separated and on- 
ly the inter mode coded frames are transmitted to the 
operation unit 1 40. The operation unit 1 40 calculates the 
average value of the amount data required for an inter 

45 mode coded frame and transmits a signal correspond- 
ing to the average value to the comparison unit 1 50. The 
comparison unit 150 compares the input average value 
signal with a predetermined threshold. When the aver- 
age value is greater than the threshold, it is determined 

50 that there is movement in the received image signal and 
a corresponding motion signal is output. If the average 
value is less than the threshold, it is determined that 
there is no movement. When there is no movement in 
the received image signal, the average data size is very 

55 large. Thus, a threshold can be easily determined and 
a motion in a frame image can be easily detected based 
upon size of the average value of the inter mode coded 
frames. Furthermore, when the change in the average 
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value is calculated and compared with a threshold, de- 
tection of a motion is improved. 
When the corresponding motion signal is output from 
the comparison unit 150, it has been determined that 
there is movement in the received image signal and the 
signal is transmitted to the output unit 1 60 from the com- 
parison unit 1 50. The output unit 1 60 can output a warn- 
ing signal, in response to the received motion signal 
from the comparison unit 1 50. When the warning signal 
is output, the frame with the detected motion is stored 
into the DVR and variously emails or other message 
types are sent to an owner, the police or a security com- 
pany. The emails or oither messages may included the 
frame with the motion and use sound. 
[0034] Referring to Figures 6A and 6B P frames 1, 6 
and 11 are intra mode coded frames (l-Frame), frames 
3,4,5,7,8,9,10 and 1 2 are inter mode coded frames 
(B-Frames and P-Frames), and the solid line is the av- 
erage bit length. A motion is included in frame 3. The bit 
length of the intra mode coded frames are more than 
the average bit length. Thus, it would be difficult to detect 
motion from a bit stream including l-Frames and this pro- 
vides the rationale for separating the intra-mode coded 
frames from the inter-mode coded frames. Therefore, 
motion can be easily detected depending upon changes 
in the bit lengths of inter mode coded frames, which rep- 
resent the difference between a motion compensated 
image and an original image after finding a motion vec- 
tor between the motion compensated frame image and 
the original image frame. 

[0035] Referring to Figure 6B, when there is little mo- 
tion in the image, the bit length of the inter mode coded 
frames is almost zero, see for example frame 2. How- 
ever, when there is much motion in the image, the bit 
length of the inter mode coded frames is long in relation 
to the average bit length for inter mode bit coded frames, 
see for example frames 7, 8, 9, 10 and 12. Therefore, 
motion can be easily and reliably detected if the bit 
length of an inter mode coded frame is longer than the 
average bit length of the inter mode coded frames. 
[0036] Referring to Figures 7A and 8A, the average 
bit length value for the whole encoded bit stream, i.e. 
with both inter mode and intra mode coded frames, 
shows very little change in response to motion occuring. 
Even, if a threshold is set high, the motion is hardly de- 
tectable. Thus, supporting the rationale for excluding the 
intra mode image bit stream. However, as shown in Fig- 
ures 7B and 8B, when only the inter mode coded frames 
are used, the deviation arising from motion is great in 
relation to the average bit length of the inter mode coded 
frames and, thus, motion is easily and reliably detected 
even though a low threshold has been set. 
[0037] Accordingly, the apparatus detecting motion in 
image signals and the method thereof according the 
present invention can easily and reliably detect motion 
by using inter mode coded frames after removing intra 
mode coded frames from the bit streams of the image. 
Advantageously, according to the present invention, the 



motion of the image can be detected by using an encod- 
ed bit stream already generated by compression proc- 
esses in an image monitoring system, for example, for 
purpose of recording/archiving, without adding a sepa- 

5 rate circuitry or memory. More particularly, typically, only 
software processes utilizing the generated encoded bit 
streams are implemented in the image monitoring sys- 
tem. Further, motion detection can be more reliable by 
substantially reducing false motion detections because 

10 of an image signal noise. 



Claims 

'5 1. A video motion detection method characterised 
by: 

obtaining inter-frame coded frames of a video 
bit stream comprising inter-frame and intra- 
20 frame coded frames; 

maintaining an average of the inter-frame cod- 
ed frame bit lengths; and 
determining the presence of motion in the 
scene represented by said video bitstream us- 
25 ing said average. 

2. A method according to claim 1 , wherein the pres- 
ence of motion is detected by comparing said aver- 
age with a threshold. 

30 

3. A method according to claim 1 , wherein the pres- 
ence of motion is detected by comparing the rate of 
change of said average with a threshold. 

35 4. A video motion detection apparatus characterised 
by: 

means (130) for obtaining inter-frame coded 
frames of a video bit stream comprising inter- 
40 frame and intra-frame coded frames; 

means (140) for maintaining an average of the 
inter-frame coded frame bit lengths; and 
means (150) for determining the presence of 
motion in the scene represented by said video 
45 bitstream using said average. 

5. An apparatus according to claim 4, wherein the 
means (1 50) for determining the presence of motion 
is configured to detect motion by comparing said av- 

so erage with a threshold. 

6. An apparatus according to claim 4, wherein the 
means (1 50) for determining the presence of motion 
is configured to detect motion by comparing the rate 

55 of change of said average with a threshold. 

7. An apparatus according to claim 4, 5 or 6, wherein 
the means for extracting inter-frame coded frames, 
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the means for maintaining an average of the inter- 
frame coded frame bit length and the means for de- 
termining the presence of motion in the scene rep- 
resented by said video bitstream using said aver- 
age are implemented by a programmed computer. 

8. A signal representing computer program codes for 
programming a computer to form an apparatus ac- 
cording to claim 7. 

9. A signal according to claim 8, comprising an electric 
or electromagnetic signal. 

1 0. A data carrier from which a signal according to claim 
8 can be reproduced. 

11. An apparatus detecting a motion in an image data, 
comprising: 

a separation unit separating a bit stream in re- 
lation to a motion predicted image from a com- 
pressed image bit stream; 
an operation unit calculating an average value 
of the bit stream in relation to the motion pre- 
dicted image; and 

a comparison unit comparing the calculated av- 
erage value and a predetermined threshold to 
output a motion detecting signal when the av- 
erage value is greater than the predetermined 
threshold. 

12. The apparatus detecting a motion in an image data 
of claim 11 , wherein the motion predicted image is 
an inter mode image. 

13. The apparatus detecting a motion in an image data 
of claim 11 , further comprising an output unit out- 
putting a warning signal in response to the motion 
detecting signal from the comparison unit. 

14. The apparatus detecting a motion in an image data 
of claim 11, further comprising a transmission unit 
transmitting the image data with the detected mo- 
tion in response to the motion detecting signal. 

15. An apparatus detecting a motion in an image data, 
comprising: 

a separation unit separating a bit stream in re- 
lation to a motion predicted image from a com- 
pressed image bit stream; 
an operation unit calculating an average value 
in relation to the motion predicted image and a 
changing ratio of the average value; and 
a comparison unit comparing the changing ratio 
of the average value and a predetermined 
threshold to output a motion detecting signal 
when the changing ratio is greater than the 



threshold. 

16. The apparatus of detecting a motion in an image 
data of claim 15, wherein the motion predicted im- 

s age is an inter mode image. 

17. The apparatus of detecting a motion in an image 
data of claim 15, further comprising an output unit 
outputting a warning signal in response to the mo- 

10 tion detecting signal from the comparison unit. 

18. The apparatus of detecting a motion in an image 
data of claim 15, further comprising a transmission 
unit transmitting the image data with the detected 

*5 in response to the motion detecting signal. 

19. A method of detecting a motion in an image data, 
comprising: 

20 separating a bit stream of a motion predicted 

image from a compressed bit stream; 
calculating an average value of the bit stream 
of the motion predicted image; and 
detecting the motion in the image data when the 
25 average value is greater than a predetermined 

threshold after comparing the average value 
and the threshold. 

20. The method of detecting a motion in an image data 
30 of claim 19, further comprising outputting a motion 

detecting signal in response to a detected motion. 

21 . The method of detecting a motion in an image data 
of claim 20, further comprising transmitting the im- 

35 age data with the detected motion in response to 
the motion detecting signal. 

22. A method of detecting a motion in an image data, 
comprising: 

40 

separating a bit stream of a motion predicted 
image from a compressed bit stream; 
calculating a changing ratio of an average value 
of the bit stream of the motion predicted image; 
45 and 

detecting the motion of the image data when 
the changing ratio is greater than a predeter- 
mined threshold after comparing the changing 
ratio and the threshold. 

50 

23. The method of detecting a motion in an image data 
of claim 22, further comprising outputting a motion 
detecting signal in response to a detected motion, 

55 24. The method of detecting a motion in an image data 
of claim 23, further comprising transmitting an im- 
age data with the detected motion in response to 
the motion detecting signal. 



20 



25 



6 



11 



EP 1 333 682 A1 



25. A computer system, comprising: 

a programmed computer processor detecting a 
motion in an input frame image of a sequence 
of frame images in response to a length of a 5 
compressed bit stream of a motion predicted 
image of the input frame image. 

26. A network image monitoring system compressing 
image signals and detecting a motion in a frame im- 10 
age, comprising: 

an image input unit transmitting the image sig- 
nals; and 

a programmed computer processor generating '5 
a compressed bit stream, separating a bit 
stream of a motion predicted image from the 
compressed bit stream, calculating an average 
value of the bit stream of the motion predicted 
image, and detecting a motion in the frame im- 20 
age based upon the calculated average value. 
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